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Abstract 

At Michigan State University (MSU) we have developed 
and are testing a faculty survey instrument to gather institution¬ 
wide information on outreach activity. We have sought to define 
consistent quantitative measures that can be used both to describe 
the whole institution’s investment of resources in engagement 
activities and to establish expectations of what individuals and 
units should contribute to meeting the institution’s outreach or 
engagement mission. In this article we first discuss MSU’s defi¬ 
nition of outreach/engagement as a form of scholarship and the 
conceptual and political issues that arise in determining what 
activities should be counted. Second, we explain some impedi¬ 
ments experienced in creating an appropriate survey instrument 
and some general barriers to collecting data on outreach activi¬ 
ties. Thud, we describe the data collection strategy. Finally, we 
discuss the online survey tool itself and the types of quantitative 
data we seek. 

Introduction 

A s recognition grows that outreach and engagement 1 are 
significant aspects of a university’s responsibility, universi¬ 
ties must document their overall performance and that of academic 
units and faculty in outreach efforts. Such documentation will be 
useful in several ways: 

• as a means of assessing an institution’s overall enactment of 
its engagement/public service mission; 

• as a management and planning tool for ensuring that individual 
academic units contribute appropriately to the institution’s over¬ 
all engagement commitment; 


’At Michigan State University we chose to identify this area of activity 
as “outreach—in a deliberate attempt to distinguish it from “public service,” 
“service,” or “extension”—but we could just as well have called it “engage¬ 
ment.” In this article we use the terms interchangeably. 
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• as a basis for “telling the engagement story” to the institutions’ 

publics; 

• as a new rubric for comparing peer institutions nationally. 

Current discussions about outreach’s growth and potential impact 
rest pumanly on descriptions and assessments of individual projects 
or groups of like projects. Although they provide valuable insights, 
they do not persuasively demonstrate institution-wide commitment 
to or achievement in outreach. The documentation must, at least in 
part be quantitative, so that comparisons among units or among 
institutions are not based solely on anecdotal claims. 

At Michigan State University (MSU) we have developed and 
are testing a faculty survey instrument to gather institution-wide 
mformation on outreach activity. We have sought to define consistent 
quantitative measures that can be used both to describe the whole 
institution s investment of resources in engagement activities and 
to establish expectations of what individuals and units should contrib¬ 
ute to meeting the institution’s outreach or engagement mission. 
Alter a decade of championmg outreach, MSU’s leaders are de¬ 
manding outreach productivity measures to help guide them in the 
management of faculty time and other resources. 

In this article we discuss, first, MSU’s definition of outreach/ 
engagement as a form of scholarship and the conceptual and politi¬ 
cal issues that arise in determining what activities should be counted. 
Second, we explain some impediments experienced in creating an 
appropriate survey instrument and some general barriers to col¬ 
lecting data on outreach activities. Third, we describe the data col¬ 
lection strategy. Finally, we discuss the online survey tool itself 
and the types of quantitative data we seek. 

Definition of Outreach/Engagement 
at Michigan State University 

MSU defines outreach as activity in which academic staff en¬ 
gage with external oigamzations and communities in a reciprocal 
earnmg/teachmg situation that increases both the external partners’ 
capacity to address issues and the academic staff’s capacity to pro¬ 
duce scholarship that better reflects the realities outside the labora¬ 
tory or the library. Relying heavily on Boyer’s ( 1990 ) work on rede¬ 
fining scholarship, a 1993 faculty committee formally defined out¬ 
reach as a form of scholarship that cuts across teaching, research 
and service. It involves generating, transmitting, applying, and pre¬ 
serving knowledge for the direct benefit of external audiences in 



Measuring Scholarly Outreach at MSU 143 


ways that are consistent with university and unit missions.” (Provost’s 
Committee on University Outreach 1993 , 1). A subsequent committee de¬ 
fined the dimensions of quality outreach and produced an evaluation 
and planning guide ( Committee on Evaluating Quality Outreach 2000). 

There are two traditional ways of accounting for a university’s 
outreach accomplishments: through reviewing individual faculty 
reports on their service activities, and through aggregating institu¬ 
tional expenditures on “public service.” Neither method serves an 
institution that seeks to tie outreach to scholarship. First, the units 
of analysis are activities that are 
separate from teaching and research 
rather than integral to scholarly ac¬ 
tivities—whether under the heading 
of research, teaching, or service— 
that are designed to help commu¬ 
nities address their pressing issues. 

Further, these methods group under 
the rubric of “service” many activi¬ 
ties that are not outreach, such as 
service to one’s institution, service 
to one’s discipline or profession, 
and community service activities in 

which the faculty member partici- ___ 

pates as a citizen but not as a schol¬ 
arly expert. 

At the individual level, “service” is one of the three mission 
areas (“teaching” and “research” are the others) into which faculty 
group their activities in annual reports or in promotion documents. 
Unfortunately, faculty use the service category to report all activities 
that are not clearly traditional classroom teaching, student advis¬ 
ing, and library or laboratory research. It has become a catchall of 
unrelated activities, where one reports service to one’s college along 
with service in the community, and anything else that cannot be 
claimed in the “more important” categories of “research” and 
“teaching.” Since Michigan State does not define “service” and 
“outreach” as synonymous, the current system of faculty reporting 
obscures the scope of the university’s outreach commitment. 

At the institutional level, the attempts at collecting data on 
outreach activity through the Integrated Postsecondary Education 
Data System (IPEDS) are no more successful in illuminating out¬ 
reach activity. That reporting system characterizes an institution’s 
commitment to public service based on its “service” expenditures, 


“After a decade of 
championing outreach\, 
MSU’s leaders are 
demanding outreach 
productivity measures 
to help guide them in 
the management of 
faculty time and other 
resources ." 
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both in dollats and as a percentage of the institution’s overall bud¬ 
get. This measure, we think, produces a misleadingly simplistic 
pproach to assessmg outreach commitment. To respond to IPEDS 
Michigan State scours its table of accounts and assigns to “public 
service ’all Arose that have an academic element butdo not appeal 

catelr r , fe f arCh ’” “ instruct ion,” or “academic support.” This 
J 17 “ cudes account s set U P to receive and expend client pay- 

ctaMishth, SemC6S ’ gely ' 11 a ‘ S0 incIudes accounte explidtty 
established to receive outside funds for delivering service - coop- 

dozens oflrnaT ma '° r elCment ’ bUl PUb ' ,C hroac toasting and 
endowments to support such things as a refuge for 

battered students and staff or the cyclotron director’s discretionary 

fhnd are also listed. However, the outreach or engagement activit^ 

ocated at the heart of the academic institution is not included Tte 

adivihes of the psychology professor who helps to design more 

effective channels of communication among a community^ social 

service agencies or of the education professor advismg the ^ate 

board of education are not tabulated. The three people who provide 

aCr0SS ‘ he CampUS are ulciuded ^ MSU’s 
* e C01 7 Lmily Work ofibrt y or so faculty and the 
nearly ,500 stadents in their service-learning classes are not The 

medical school s practice plan earnings appear but not its interven¬ 
tion to lower the incidence of heart disease in an African-American 

h,i!t! m , Un ^i, e ?' ,SC * heSe en 8 a 8 ement activities are not separately 
budgeted, they do not appear in the accounting system. Y 

We believe an accurate picture of an institution’s commitment 

‘n”'” b " »"'y wh,» i, m , “ 

reach and engagement activities that are integral to the research 
and teachmg work of the faculty. Since sue! activitfes dT^ 
normally appear as separately assigned or budgeted activities 

o7a“t“f;:r al effort to identify indicators w,thm the c ° re 

Impediments and Barriers 

When trying to assess outreach activity, two major issues ire 
especially troubling, particularly the intertwining of outreach in 
research and teaching. The first issue is developing a commonSri” 
f measurement for quite different activities. Outreach occurs in 
nearly a 1 institutions of higher education and in most academic 

units Th^" them ’ b r* 14 d ° eS not occur in discrete, comparable 
units. That is, most of the activities that fall under the rubric of en¬ 
gagement or outreach do not give rise to comparable “transactions” 
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that oarallel the “credit hours offered” or “kinds of degrees awarded 
or “research monies received” that we use to represent teaching 
nd research Finding the common scale or measure that will allow 
m to compare a finance professor’s giving a talk to the local Kiwams 
club to a professor and her class’s work with a community to redesign 

the town’s waterfront is daunting. 

A second issue is the difficulty 
of encouraging faculty to supply the 
information on which measures of in¬ 
stitutional performance rest. Lack of 
compliance, of course, bedevils all 
foci of institutional research, but it is 
exacerbated in an area whose defini¬ 
tions remain somewhat murky and 
contested and where there is no clear 
relationship between activities reported 
and rewards granted. 

First, many faculty have diffi¬ 
culty seeing how the definition (and 
more especially the shorthand phrase 
distilled from it—“outreach as schol¬ 
arship”) relates to their academic 
work. Broadening the definition of scholarship, as Boyer and others 
have suggested, seems to make more sense to scholars m the disci¬ 
plinary traditions of the social and behavioral sciences than it does 
to those in the traditions of physical, biological, and engineering 
sciences Many find the concept of simultaneous research and out¬ 
reach or teaching and outreach difficult to comprehend and apply 
to their work. Used to categorizing their work into discrete sections, 
they resist seeing that some of it should be counted in more than 
one section. Others react in just the opposite way and contend that 
everything they do should count as outreach. 

Second, because outreach activity is so varied, we have to ask 
for more information on each activity in order to classify and quantify 
it—ten questions rather than two or three. Because the rewards— 
salary increments or promotion or even collegial respect—are not 
as clear for outreach accomplishments as they are for research (and 
to some degree teaching), faculty do not see much benefit in keeping 
track of and reporting on their outreach work. Faculty see little 
evidence that the university’s public commitment to serving society 
through outreach results in higher recognition for those who spend 
considerable time and effort working with groups and communities 
external to the campus. 


“[M]ost of the 
activities that fall 
under the rubric of 
engagement or 
outreach do not give 
rise to comparable 
“transactions” [such 
as those used] to 
represent teaching 
and research . ” 
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Data Collection Strategy 

askedIXiimofl? i " deVe ' 0pmg a data co ' lect ion strategy, we 
asKea a group of about twenty-five faculty to identify a « 

w« »««-y «.««h W.t rt 

outreach research, clinical service, student experiential/service 
learning, and public events and information. This classification 
scheme was developed with two -sometimes co fi.c nSoak 

On the one hand, we wanted a list s g 

sufficiently comprehensive that--- 

far-rrlfxr ■>« nil 1 _ „_* ■ 11 . 


“[W]e wanted to craft 
definitions that 
restricted the activities 
to be counted to those 
that related to scholarly 
work and that employed 
the disciplinary 
expertise of the faculty 
participants. ” 


faculty in all roles and in all depart¬ 
ments could understand how then- 
work did and/or could contribute to 
Michigan State’s outreach effort. 

On the other hand, we wanted to 
craft definitions that restricted the 
activities to be counted to those 
that related to scholarly work and 
that employed the disciplinary ex¬ 
pertise of the faculty participants. 

Because of this tension, it is worth 
reviewing the definitions in some 
depth. ——————__ 

Outreach instruction includes off-campus and online credit and 
noncredit instructional programs that are specially designed and 
marketed to serve external students who are Lther campus de«2 
seekers nor the institution’s staff. Instruction targeted^ other Sa 
demies and noncredit courses targeted at campus staff are excluded 

smeThaT 1 ” 8 P 3 * 10 ' 15311 * h °*®5—that is, a CEU-like seat-time mea¬ 
sure that can be aggregated across varied instructional formats 
to measure noncredit instruction. tormats— 

Outreach research includes applied research, capacity building 

l' Lla "’ n ud '® s ’ P° hc y analysis, technical assistanceand tech’ 
nology transfer. Such activities are considered outreach when thev 

organ° nd f- Cted coIlaboratio,1 or partnership with schools health 
organizations, nonprofit organizations, businesses, industries gov- 

invn// agencies > and other external constituents. Best practice 
idenff *d , anng goals ’ cx P ert ise, and resources; it results in mutually 
dentified benefits including scholarship by faculty engaged in the 
partnerships. This category is meant to include Ej t 
which faculty use their expertise to interact with external! 
on a continuous basis in a reciprocal relationship in which the fecX 

member is both learning and teaching. wmen the faculty 
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Clinical service includes all client/patient services—human and 
animal—provided by university faculty through unit-sponsored 
group practice or as part of their clinical instruction, and by medi¬ 
cal and graduate students as part of their professional education. 

Student experiential/service learning includes faculty activi¬ 
ties in supervising or directing civic or community service per¬ 
formed by students. The category includes traditional course-based 
service-learning, career-related internships or practica, and students 
volunteering in the community if faculty are involved. The experi¬ 
ences should be carefully integrated with the student’s academic ex¬ 
perience and should incorporate frequent, structured, and disciplined 
reflection on the linkages between the civic/service activity and 
the content of the academic experience. How strictly to interpret 
“service” in this category was a difficult question. Students choos¬ 
ing to serve, either as volunteers or as part of a class, often have 
dual objectives—to serve society, and to learn more about career 
choices and build resumes. Thus, we found it difficult to determine 
when an activity moved from our service-learning category into a 
“career preparation” category. The faculty committee raised such 
questions as. Should we include in this category tutoring in K-12 
schools that is part of a teacher preparation program, or interning 
with a government agency that caps the pre-law preparation pro¬ 
gram? Rather than restrict the category, we chose to give the fac¬ 
ulty all three options—academic service-learning, career-related 
service, and volunteerism—though we are most interested in the 
data from the first option. 

Public events and information counts university resources that 
are developed and maintained through scholarly activity and made 
accessible to the public. Resources for the public may include man¬ 
aged learning environments (museums, libraries, gardens, gal¬ 
leries), virtual environments (Web sites, public broadcasting), 
educational materials and products, and short-term learning 
events (such as expositions, exhibits, demonstrations, and fairs). 
Activities in this category are mostly learner-directed in that learn¬ 
ers usually visit or participate on their own, decide when and how 
long to visit or participate, and choose which of the available interpre¬ 
tive materials to use. For activities in this category, the application of 
scholarship and the experience of the external audience are widely 
separate in time and/or space. This category is meant to include only 
those performances, exhibits, pamphlets, and so on, for which faculty 
and academic staff were significantly involved in the design of those 
events or artifacts. 
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notcWto“rwf~ itieS rH v ek to C0Unt (and does 
nature. They repZZlS l °T ^'stiieir “discretionary” 

(and thus, indirectly, by the institutionfr^ 31 &CUlty members 
faculty time) that could ) t0 mvest resources (i.e., 

university’s ZZ too 2,l I K “ ° rder to «* 
activities is the fact ha d™ 0ub f cb fusion. Ba.s.c t° all of the 

-to* .ton t—d 

jng, teaching, and research of participate 'ft? 40 leam ' 

labor intensive and have uncertain out™ ’ the , actlvIt,es te ” d to be 
vice-learning experience in a course Z J " c °rporatmg a ser- 
than a standard lecture-discussion f ** f*?* facuIty or staff time 
available for preparing a Z, ZST* ^ ^ lon ^ 
However fruitful worklneZth fl ™ " ° r adviisin S students, 

issue of youth violence may be for thc'ros'^ ? address ’ say > the 
collaboration is, by definition m „ u searcber . the process of 

unpredictablethknLtoZtoTnZ tZ “» 

toty. Thus the college or univereitv ZTrie ^ ° r the labora ~ 

that mark it as a unique institution t md ? t0 Share the resources 
the community is mlldnu a res .f Cademic ex P erti se—with 

™d.«. .fi« 


The Outreach Measurement Instrument 

ers, we developed^and^Za'wcb b 080 ^ 8 ’ andpossibie barri - 
collect data on fecuirif ontZ u ^. eb : based survey instrument to 
versify Outreach MeasurZem In ^ Mich ¥^ Uni- 
three sections. The first two section “ ment / OMI ) ,s divided into 
data; the third section encourages r q . UIre mostly quantitative 

“ ‘■“ ”«*" to— ik » “» 

t«lpi»i 7 ,Ze f iTo > ',“T ,i “i* '“" ek 

year. In order to capture the ^ U f f &Ch WOrk durin g the reporting 
grated with faculty research teacMns at n ‘]'' treacb is generally inte- 
that this is a duplicative me^ Th;? W£ ad ™>wledge 

to count “all work that has an n n- 6 u U1VCy mstracts respondents 
portion of your teacliing research and COmpoaent ’ inciuding that 
the direct and inrnrcSZnZtod “ *** COnducted for 
emy.” This same quesZntod oZ T T M * ‘° ^ acad ‘ 

™, .to-tog, 
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are asked to estimate what part of that 100 percent effort included 
ah outreach component. As faculty time is the university’s most 
valuable resource, determining how much of that time involves 
faculty in engagement with the external community is, we believe, 
the best single measure of institutional commitment to outreach. 

The second section asks respondents to characterize the out¬ 
reach activities or projects on which they spent the most time. The 
responses allow us to categorize outreach activity along several 
dimensions and thus contribute to better assessment and manage¬ 
ment of outreach as a campus-wide activity. The dimensions include: 

• area of concern • location 

• type of activity * revenues 

• partners or groups involved 

The primary dimension is “area of concern.” Faculty are asked 
to choose one or two areas from a twelve-item menu that includes 
such areas as community and economic development, public safety 
and corrections, or preK-12 education. Although some faculty’s 
outreach activities touch on many different social issues, we ask 
them to limit their selections to no more than two of the areas of 
concern. Most, we expect, will 
choose the two on which they 
spend the most time, but they can 
report on any aspect of their ac¬ 
tivities even though it was not the 
most time consuming. We then ask 
what percentage of their outreach 
effort they devoted to each area of 
concern. Examination of the dis¬ 
tribution of faculty tune across the 
areas of concern allows us to judge 
whether individual faculty outreach 
efforts aggregate into an appropri¬ 
ate spread over the areas of concern—to ensure that efforts aimed 
at strengthening preK—12 education are not leading to relative ne¬ 
glect of economic development, for example. 

The remainder of the second section probes further into their 
work in the one or two identified areas. For each chosen area of 
concern, we ask whether their work has a particularly international 
or urban focus, where the work took place (on a menu ranging 
from specific Michigan counties to global), and what type of outreach 
work (outreach instruction, clinical service, etc.) they are doing. 


“Although engagement 
activities surely 
enhance the learning, 
teaching, and research 
of participants, the 
activities tend to he 
labor intensive and have 
uncertain outcomes . ” 
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sense of the outcome!of menufedlfctmrs” 

their outreach work . basiness and industry managed 
and in discovering ' labor adv °cacy and employment 

support personnel, etc.). While 
his section’s first question—on 
area of concern”—identifies the 

target of their outreach work the 

second focuses on their cio! 

tutors. Thus a faculty member" 
scientific understanding among lm provement in 

might collaborate directly with some 1 ? students, but she 

:r ■ - 

.contracts, or tuition 
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aome aspect of it. In piloting earlier 




Measuring Scholarly Outreach at MSU 151 


encountered an insistent demand for qualitative evaluation from 
some faculty who contended that efforts to quantify the outreach 
effort ignored, even suppressed, what is unique and important about 
outreach. Section three provides an opportunity for faculty to de¬ 
scribe the importance of their work. A series of prompts ask them 
to describe the actions they took, for whom, with which collaborators 
(internal and external), and about what issue or problem. They are 
asked to specify how long the project has been under way and what 
plans, if any, there are for sustaining it, since the length of time a 
collaborative project is sustained is a good measure of outreach suc¬ 
cess. We are particularly interested in obtaining a sense of the out¬ 
comes of their outreach work—occurring both in the external com¬ 
munity and in their own teaching or research—and in discovering 
whether any formal evaluation of the project occurred. 

We do not expect to incorporate the data collected from this 
third section into the management analysis. Rather, we see the infor¬ 
mation gathered here as a rich storehouse of examples of how fac¬ 
ulty expertise contributes to strengthening people’s capacity to 
achieve their goals. We plan to use this information as the basis for 
stories for the news media, for our president’s speeches and conver¬ 
sations across the state, for communication with the legislature and 
the alumni, and, perhaps most important, for communication to the 
faculty and staff about how their university enacts its outreach mis¬ 
sion and how they might participate. We do not know how many 
faculty will avail themselves of the opportunity to give us tills detail, 
but we expect that those who do will be the ones most involved in 
outreach and whose projects are most worthy of publicity. 

Conclusion 

Our data collection goal is to amass a rich array of information 
that we can use in a number of different ways. First, we will use 
the data as a management tool. We can examine changes in an 
academic unit’s portfolio of outreach projects over time and survey 
the institution’s overall portfolio of projects. Such information can 
be used in the planning and resource allocation process. Second, 
faculty documentation of outreach activities better enables us to 
count outreach in the allocation of “rewards” to faculty and units. 
Third, the information can be used as a major communication and 
publicity tool. Finally, we hope that what we leam can help pro¬ 
vide a more accurate classification and definition of outreach/en- 
gagement for national forms of data collection and reporting. 
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